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O (57) Abstract: This present invention discloses a system and method for enhancing images of barcodes and other similar objects 
O taken by the digital camera connected to or embedded in a mobile device. This filter works by converting the image into its equivalent 
^ gray scale. The algorithm then computes the mean pixel intensity value of a row of pixels in the image. The row is divided into 
sections and the mean pixel intensity of each section is also calculated. The pixels in each section are processed according to the 
relation of the relative mean intensities of the row and the section. Once each pixel has been processed, the image is reassembled 
from its divided sections. 
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GROUP AVERAGE FILTER ALGORITHM FOR DIGITAL IMAGE 

PROCESSING 



TECHNICAL FIELD OF. THE INVENTION 

5 The present invention relates generally to-. the field 

of image enhancement algorithms. More specifically, the 
present invention utilizes an algorithm designed to 
sharpen images of barcodes to aid in decoding, 

10 BACKGROUND ART 

Barcodes have been utilized for identifying and 
pricing objects for more than thirty years. Most 
typically, barcodes are used in retail to identify the 
item of merchandise. For example, a gallon of milk may 

15 contain a barcode that, when scanned, will notify the 
cashier of the price of the milk. 

Yet in recent years, barcodes have acquired new 
purposes as computers and barcode scanners have become 
more portable. The circuitry required to scan a 

20 conventional one-dimensional barcode can now be housed in 
a device as small as a typical keychain. As a result, 
many mobile telephones, personal digital assistants 
("PDAs"), and pagers can be retrofitted with or connected 
to a laser-based scanning device. This allows the mobile 

25 device to function as a scanner capable of storing 
hundreds or thousands of scanned barcodes. 

Currently, many cell phones and mobile devices are 
available with built-in cameras. The explosion of the 
availability of affordable digital cameras and their 

30 inclusion into mobile devices is driven by several 
factors . One of the most important is the recent 
availability of inexpensive image sensors based on CMOS 
technology. The cameras on these devices provide a means 
for capturing the barcode information which was 
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previously only accessible via a laser-based scanner. 
Decoding barcode images from digital cameras included in 
mobile devices presents several difficult problems. 
These problems go well beyond the challenges addressed in 

5 commercial barcode readers. Some of these problems are 
addressed below: 
Lighting: 

Most mobile devices with integrated digital cameras 
do not have built-in flashes and rely solely on the 
10 ambient light for illumination. This can cause the image 
to be underexposed or overexposed depending upon the 
intensity of the ambient light. Bad lighting may also 
cause the image to appear shadowy. 
Focus: 

15 Digital cameras for portable devices are usually 

designed to work at a variety of distances. The need for 
a wider range of focus in cameras results in a trade off 
between the cost of the lens component and the sharpness 
of a typical image. 

20 Low-cost lens components: 

In order to meet cost constraints of many portable 
device markets, manufacturers often compromise on the 
optical quality of camera lenses. This can present 
decoding technology with a different set of challenges 

25 from the simple focal length based focus problem noted 
above. Low-cost lens components can produce image 
distortions that are localized to a specific region or 
form a changing gradient across the image. 
Limited resolution: 

30 The cost of a digital imaging CMOS sensor increases 

as the number of image pixels increases. Although the 
Asian market has seen the release of general purpose 
consumer devices like PDAs and cell phones with 
"megapixel" image resolution, the European and North 
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American markets are now only seeing their emergence. 
Lower resolution images contain less detail and usually 
require further processing to be useful. 

Based on the aforementioned described problems with 

5 mobile digital imaging, there clearly exists a need for 
an image enhancement algorithm which can compensate for 
the poor images which result from these shortcomings. 
Such an algorithm would allow a greater number of images 
acquired via digital imaging techniques to be decoded. 

10 

DISCLOSURE OF THE INVENTION 

The present invention provides an algorithm designed 
to apply an image-processing filter which mainly 
suppresses the high frequencies in the image and filters 

15 the low frequencies, thus smoothing the image and 

enhancing the detection of edges. First, the sharpening 
algorithm converts the gray-scale barcode image is broken 
down into a two-dimensional array. Each entry in the 
two-dimensional array stores the intensity of a single 

20 pixel. 

The image is then converted to a grayscale image. 
Typically, this is done by mapping each color pixel to 
its equivalent in grayscale. Next, a row of pixels from 
the image is selected for processing. The mean intensity 

25 of the row is computed by averaging all of the pixel 
intensities from the row. 

The row of pixels is then divided into three to ten 
equal sections. The number of sections can either be 
selected by the user or predetermined by the image 

30 processing algorithm. The mean pixel intensity of each 
section is also computer by averaging the pixel 
intensities in each section. If the mean intensity value 
for a section is greater than the mean intensity value 
for the entire row, the pixel intensities are 
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recalculated for that section utilizing a proprietary 
formula. Generally, if a pixel's intensity is slightly 
greater than the average pixel intensity for that 
section, the pixel is assigned an intensity value 
5 identifying it as "white." If a pixel's intensity is 
slightly less than the average pixel intensity for that 
section/ it is assigned an intensity value identifying it 
as "black." Pixels having an intensity value close to 
the mean value are typically not changed. 
10 If the mean intensity value for a section is less 

than the mean intensity value for the entire row, the 
pixel intensities are recalculated for that section 
utilizing a similar proprietary formula. Generally, if a 
pixel's intensity is slightly greater than the average 
15 pixel intensity for that section, the pixel is assigned 
an intensity value identifying it as "white." If a 
pixel's intensity is slightly less than the average pixel 
intensity for that section, it is assigned an intensity 
value identifying it as "black." Pixels having an 
20 intensity value close to the mean value are typically not 
changed in this instance either. 

Once each pixel in the row has been processed 
utilizing the above described process, the enhanced image 
is reconstructed by rejoining the sections of the row. 
25 The row is then available for decoding. 

Therefore, it is an object of the present invention 
to provide a group average filter capable of sharpening a 
row of pixels to aid in optical decoding. 

An additional object of the present invention is to 
30 provide an image enhancement algorithm which divides a 
row of pixels from an image into sections prior to 
processing. 

Another object of the present invention is to 
provide an image enhancement algorithm which utilizes the 
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mean intensity for the row of pixels in processing each 
section of the row. 

It is also an object of the present invention to 
provide an image enhancement algorithm which converts the 
5 image to grayscale prior to processing. 

These and other objects of the present will be made 
clearer with reference to the following detailed 
description and accompanying drawings. 



10 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 depicts a flowchart showing the process 
utilized to sharpen an image. 

FIG. 2 A depicts a typical barcode image acquired 
using a digital camera. 
15 FIG. 2B depicts the barcode of FIG. 5B after it has 

undergone sharpening utilizing the sharpening filter of 
the present invention. 

BEST MODE(S) FOR CARRYING OUT THE INVENTION 

20 The following presents a detailed description of a 

preferred embodiment (as well as some alternative 
embodiments) of the present invention. However, it 
should be apparent to one skilled in the art that the 
described embodiment may be modified in form and content 

25 to be optimized for a wide variety of situations. 

With reference first to FIG. 1, shown is a flowchart 
depicting the steps of the image enhancement algorithm of 
the present invention. The image enhancement algorithm 
has been shown to be particularly effective for 

30 sharpening rows of pixels from a barcode image. First, 
the sharpening algorithm converts the barcode image into 
a two-dimensional array in step 101. Each entry in the 
two-dimensional array stores the intensity value of a 
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single pixel. The image can 
function as follows: 

n-1 
Image = £ 
5 x=Q 



PCT/US2004/013100 
now be described as a 

m-1 

E f(x, y) 
y=0 



where n is the image width and m is the image height. 

The image is then converted to a grayscale image in step 

103 by mapping each pixel to its grayscale 
10 representative. In the preferred embodiment, this is 

done utilizing a standard color to grayscale filter. 

Next, a row of pixels from the image is selected for 

processing in step 105. The mean intensity of the row is 

then computed by averaging all of the pixel intensities 
15 from the row in step 107. The mean can be represented as 

follows : 

n-1 

mean (row) - ( £ pixelColor (x, y) ) /n 
x=0 

20 

Where n is the number of pixels in the row and y is the 
horizontal pixel value of the selected row. 

The row of pixels is then divided into three to ten 
equal sections in step 109. The number of sections can 

25 either be selected by .the user or predetermined by the 
image processing algorithm. The mean pixel intensity of 
each section is then computed by averaging the 
intensities of the pixels in each section in step 111. 
If the mean pixel intensity of the section is 

30 greater than or equal to the mean pixel intensity of the 
row as determined in step 113, the intensity of each 
pixel is recalculated in step 115 according to the 
following formula: 
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if pixelColor (x,y) + p* (pixelColor (x,y) ) > mean pixel 
intensity of section, then 
New Pixel value g(x,y) = "white," else 
New Pixel value g(x,y) = "black" 
5 where, 1 ^ P ^ 20 

The value of P can either be user defined or selected by 
the algorithm. The function "pixelcolor (x,y) " refers to 
the pixel intensity stored in that particular entry in 
the two dimensional array which defines the image. The 
10 pixel intensity values assigned to "white" and "black" 

depend upon the image format being used. For example, in 
a 256 color grayscale image, pixel intensities of zero 
would be assigned to "white" and 256 would be assigned to 
"black." Pixels having an intensity value close to the 
15 mean value are typically not changed in this instance 
either. 

If the mean pixel intensity of the section is 
greater than or equal to the mean pixel intensity of the 
row as determined in step 117, the intensity of each 
20 pixel in the section is recalculated in step 119 
according to the following formula: 
if, pixelColor (x,y) - P* (pixelColor (x,y) ) > mean pixel 
intensity of section, then 
New Pixel value g(x,y) - "white," else 
25 New Pixel value g(x, y) = "black" 

where, 1 ^ P ^ 20 

The value of P can either be user defined or selected by 
the algorithm. The function "pixelcolor (x, y) " refers to 
30 the pixel intensity stored in that particular entry in 
the two dimensional array which defines the image. The 
pixel intensity values assigned to "white" and "black" 
depend upon the image format being used. 



-7- 



WO 2005/020140 PCT/US2004/013100 
Once' each pixel in the row has been processed 
utilizing the above described process, the enhanced image 
is reconstructed in step 121 by rejoining the sections of 
the row. The row is then available for decoding. 
5 An example input and output' barcode which have been 

. processed by the aforementioned sharpening algorithm are 
shown in FIG. 2A and FIG. 2B, respectively. The rows 
which were processed by the algorithm of the present 
invention as shown in FIG. 2B have more contrast between 
10 the barcode and the background of the image as compared 
to the inputted image of FIG. 2A. 

While the foregoing embodiments of the invention 
have been set forth in considerable detail for the 
purposes of making a complete disclosure, it should be 
15 evident to one skilled in the art that multiple changes 
may be made to the aforementioned description without 
departing from the spirit of the invention. 
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CLAIMS 

We claim: 

1. A method of enhancing an image comprising the steps 
of: 

5 converting the image to a two-dimensional array; 

converting said image to grayscale; 
selecting a row of pixels from said image for 
processing; 

computing the mean intensity of said pixels in said 
10 row; 

dividing said image into sections; 
computing the mean intensity the pixels of each 
section; 

processing the pixels in each of said sections 
15 according to a first method if said mean 

intensity of said section is greater than said 
mean intensity of said row; 
processing the pixels in each of said sections 
according to a second method if said mean 
intensity of said section is less than said 
mean intensity of said row; and 
disregarding the pixels in sections where said mean 
intensity of said section is egual to said mean 
intensity of said row. 



20 



25 



30 



2. A method for enhancing an image according to Claim 1, 
wherein said first method of processing pixels in a 
section consists of the steps of: 

computing the value of the intensity of each pixel 
in said section plus a percentage threshold 
multiplied by the intensity of each pixel in 
said section; and 
assigning each pixel in said section an intensity 

corresponding to white if the computed value is 
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greater than the mean intensity of said row; 
and 

assigning each pixel in said section an intensity 

corresponding to black if the computed value is 
5 less than the mean intensity of said row. 

3. A method for enhancing an image according to Claim 1, 
wherein said second method of processing pixels in a 
section consists of the steps of: 

computing the value of the intensity of each pixel 
in said section minus a percentage threshold 
multiplied by the intensity of each pixel in 
said section; and 
assigning each pixel in said section an intensity 
15 corresponding to white if the computed value is 

greater than the mean intensity of said row; 
and 

assigning each pixel in said section an intensity 

corresponding to black if the computed value is 
less than the mean intensity of said row. 
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3. A method for enhancing an image according to Claim 1, 
further comprising the step of: 

reassembling said image after said sections have 
25 been processed.. 



4. A method for enhancing an image according to Claim 2, 
wherein said percentage threshold is less than or equal 
to twenty. 

5. A method for enhancing an image according to Claim 3, 
wherein said percentage threshold is less than or equal 
to twenty. 



-10- 



WO 2005/020140 PCT/US2004/013100 

6. A method for enhancing an image according to Claim 1, 
wherein each row of said image is enhanced. 
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